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ABSTRACT:  An  NOD  study  on  the  use  of  DOD  form  lt'ij,  as  required  by  DOD 
Instruction  3200.8,  indicates  that:  (a)  26.3  percent  of  DOD  activities 

and  their  contractors  are  not  using  it;  (b)  the  descriptive  cataloging 
when  included  on  DOD  form  IU73  was  judged  to  be  of  poor  quality  in  5* 14 
pc -cent  of  all  DOB  reports;  (c)  when  DOD  form  1^73  was  included  in  DOD 
reports,  12.9  percent  were  judged  to  be  of  either  poor  quality  in  the 
subject  cataloging  (assignment  ex'  key  words),  or  provided  no  key  words 
at  all.  Positive  steps  should  be  taken  by  DOD  to  obtain  compliance  in 
the  use  of  DOD  form  1^73*  Application  of  DOD  form  1^73  to  NASA  and  AEC 
reports  should  be  negotiated  by  DOD,  in  order  to  realize  the  full  potential 
of  a  significant  cost  saving  in  technical  library  operations. 
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The  management  of  the  Naval  Ordnance  Laboratory,  White  Oak,  Silver  Spring, 
Maryland  is  vitally  interested  in  its  technical  library  operation,  ite  coats, 
and  the  important  part  it  plays  in  providing  technical  reports  to  its  scien¬ 
tific  and  engineering  personnel.  Keeping  costs  at  a  reasonable  level  and  at 
the  same  time  fulfilling  the  technical  information  mission  requires  a  constant 
examination  of  all  factors  that  contribute  to  cost.  Where  duplication  and 
unnecessary  costs  exist,  positive  steps  are  necessary  to  eradicate  the*. 
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DOD  INSTRUCTION  3200.8  -  FIVE  YEARS  LATER  -  WHAT  RESULTS? 

].  On  3  Aug1.! st  1901,  NOLTR  61-102  "A  Plan  to  Reduce  Costs  of  Technical  Library 
Operations  in  the  Defense  Department"  was  issued.  This  plan  was  also  published 
ir.  the  open  literature  in  the  journal,  "American  Documentation"  July  1962, 
p.  2 9 6- 30C-  This  plan  outlined  steps  that  should  be  taken  to  realize  significant 
cost  savings.  On  1.8  February  196k,  DOD  issued  DOD  Instruction  7200.8  which 
implemented  roost  of  the  ideas  set  forth  in  NOLTR  61-102.  Five  years  after  DOD 
Instruction  3200.8  has  been  in  operation,  what  results  have  been  achieved? 

2.  This  report  deals  with  the  effectiveness  of  DOD  Instruction  3200,8  and  its 
DOD  Form  ll‘73*  If  a  Form  1J*73  is  included  in  each  DOD-controlled  technical 
report  and  if  they  are  properly  executed  in  the  descriptive  cataloging  and 
subject  cataloging  (assignment  of  key  words  or  descriptors),  thci*  there  would 
be  an  effective  library  cost  reduction  for  eacv  recipient  of  technical  reports. 
NOLTR  61-102  pointed  out  that  this  is  a  substo.iuisl  sura  of  money. 

3.  In  order  to  determine  whether  or  not  DOD  had  achieved  the  potential  in  cost 
saving  through  DOD  Instruction  3200.8,  a  sample  of  507  reports  received  by  NOL 
from  outside  source  during  the  period  of  30  December  1968  to  16  January  1969  was 
examined.  On  the  average,  the  Laboratory  now  receives  13,^00  technical  reports 
per  year.  From  the  sample  of  507  reports  received,  the  following  factors  are 
covered: 


a.  Identification  of  sources,  with  quantity  from  each. 

h.  Identification  of  sources  required  to  use  the  DOD  Form  1^73  hy  DOD 
Instruction  3200.8,  their  compliance  and  non-compliance  with  quantities  from 

each. 

c.  Sources  required  to  use  DOD  Form  1^73  ®nd  complying  were  judged  on 
quality  in  descriptive  cataloging. 

d.  Sources  required  to  use  DOD  From  1^*73  and  complying  were  judged  on 
quality  in  subject  cataloging  (assignment  of  key  words). 
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4.  Out  of  a  sample  of  507  reports  received  during  the  period  30  C  oember  1968 
to  16  January  1969,  what  were  the  sources  of  the  reports? 


Sources 

Quantity 

Percentage 

Navy 

87 

17.2 

Navy  contractors 

115 

22.7 

39-9 

Army 

29 

5-7 

Army  contractors 

48 

9.6 

15.3 

Air  Force 

15 

2.9 

Air  Force  contractors 

99 

190 

22.4 

DASA  contractors 

8 

1.6 

1.6 

ARPA 

2 

0.3 

0.3 

DIA 

4 

0.8 

0.8 

80.3 

NASA 

25 

4.9 

NASA  contractors 

22 

4.3 

9-2 

AEC  contractors 

26 

5.1 

5.1 

Private  Industry 

4 

0.8 

0.8 

(non-govt,  contr. ) 

Foreign  Countries 

13 

2.7 

2.7 

NSF  contractor 

2 

0.3 

0.3 

CIA 

8 

1.6 

1.6 

19-7 

Totals 

507 

100* 

By  comparing  the  shove  data  with  the  data  presented  in  NOLTP  61-102,  it  will 
be  seen  that  the  sources  of  reports  sending  technical  reports  to  NOL  is  essen¬ 
tially  the  same  in  1968  as  it  was  in  I96I.  This  fact  is  probably  true  for  every 
other  DOD  component  that  has  a  technical  report,  information  storage  and  retrieval 
operation. 
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5.  Oat  of  the  507  reports  received,  a  total  of  407  vere  required  by  DOD 
Directive  3200.8  dated  18  February  196k  to  use  DOD  Form  li* 73-  How  many  used 


DOD  Form  1473? 

Used 

DOD  Form  IU73 

Did  not  use 

DOD  Form  1473 

$  not  using 

DOD  Form  1473 

Navy 

42 

45 

51.8 

Navy  contractors 

72 

^3 

o'?  i 

Army 

28 

l 

3*1’ 

Army  contractors 

44 

4 

on 

CO 

Air  Force 

13 

2 

13.3 

Air  Force  contractors 

80 

19 

19.2 

DASA  contractors 

7 

1 

14.2 

ARPA 

2 

0 

0 

DIA 

0 

4 

100$ 

Totals 

288 

119 

29.2$ 

On  the  assumption  that  this  is  a  random  sample  for  the  overall  population 
of  technical  reports,  it  can  be  stated  at  the  90$  confidence  level  that  at 
least  the  following  percentage  of  technical  reports  are  not  including  DOD 

Form  1I*73« 

_JL 

Navy 

44.0 

Navy  contractors 

31.0 

Army 

0.36 

Army  contractors 

3.7 

Air  Force 

3.6 

Air  Force  contractors 

14.0 

DASA  contractors 

1.3 

ARPA 

0 

DIA 

56.0 

Overall  26. 3% 
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6.  Of  the  288  reports  using  the  DOD  For®  1473,  the  quality  of  the  descriptive 
cataloging  was  Judged  as: 


a.  Good  -  could  he  used  without  additional  descriptive  cataloging 

work  and  put  directly  into  our  information  retrieval  system 
(means  that  a  typical  GS-3  or  -4  library  technician  can 
literally  use  the  information  on  the  form). 

b.  Poor  -  required  necessary  descriptive  cataloging  work  (to  locate 

additional  information  within  the  report  or  misplaced  on  the 
1473  fora)  for  putting  information  into  our  retrieval  system. 


Good 

Poor 

*  that 
are  poor 

Navy 

38 

4 

9.5 

Navy  contractors 

6? 

5 

6.9 

Army- 

28 

0 

0 

Army  contractors 

39 

5 

11.4 

Air  Force 

13 

0 

0 

Air  Force  contractors 

75 

5 

6.3 

DASA  contractors 

5 

2 

28.5 

ARPA 

2 

0 

0 

Totals 

267 

21 

7.5* 

On  the  assumption  that  this  is  a  random  cample  for  the  overall  population 
of  ♦•chnical  reports,  it  ccn  be  stated  at  the  90*  confidence  level  that  at 
least  the  following  percentage  of  technical  reports  containing  1^73  forms 
will  have  descriptive  cataloging  that  is  Judged  to  be  poor. 


Navy 

h.2$ 

Navy  contractors 

3-4* 

Army 

0 

Army  contractors 

5.6 * 

Air  Force 

0 

Air  Force  contractors 

3.1* 

DASA  contractors 

7.9* 

ARPA 

0* 

Overall  5.4* 
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7.  0*'  the  288  reports  using  the  00D  Form  12*73,  the  quality  of  the  subject 
cataloging  (assijiraent  of  key  vords  or  descriptors)  was  Judged  as; 

a.  Good  -  coul^  be  used  without  additional  subject  cataloging  work  and 

put  directly  into  our  information  retrieval  syster. 

b.  Poor  -  required  necessary  subject  cataloging  work  (to  locate  additional 

information  within  the  report) for  our  information  retrieval 
system. 

c.  Nothing  -  no  subject  cataloging  at  all. 


Good  Poor 


Navy  35 
Navy  contractors  62 
Army  22. 
Army  contractors  3U 
Air  Force  9 
Air  Force  contractors  73 
DASA  contractors  2* 
ARPA  2 


5 

6 

h 

3 

7 

1 

0 


Totals  2<’*3  30 


Nothing 


2 

U 

0 

7 

0 

0 

2 

0 

15 


$  that  are 
poor  plu6 
nothing 

l6,o 

13.9 

l'*.3 

22.7 

2*  2*. 5 

3.7 

75.0 

0 

IS  6* 


On  the  assumption  that  this  is  a  random  sample  for  the  overall  population 
of  technical  reports,  it  can  be  stated  at  the  90$  confidence  level  that  at 
least  the  following  percentage  of  technical  reports  containing  12*73  forms 
will  have  subject  cataloging  (assignment  of  key  words)  that  is  Judged  poor 
or  no  subject  cataloging  at  all. 


Navy  9.5$ 

Navy  contractors  8.8$ 

A  nny  6 .  !*$ 


Army  contractors 
Air  Force 

Air  Force  contractors 
DASA  contractors 
ARPA 


1- .  •$ 
12*. 2$ 
ii  ,  Q$ 

32.0$ 

0$ 


Overall  12.9$ 


5 


NOLTO  69 -bO 


8.  The  data  produced  from  this  study  shovs  that  DOD  has  "ealized  only  a  portion 
of  the  potential  in  reducing  costs  that  are  duplicated  and  wasteful.  This  is 
interesting  in  view  of  the  following  points: 

a.  In  August  1961,  NOLTR  61-102  called  att  ion  to  the  wasteful  duplication 
and  unnecessary  costs  and  outlined  a  general  plan  as  well  cs  specific  steps  that 
should  be  taken  to  reduce  costs. 

b.  In  February  I96U  DOD  issued  DOD  Instruction  3200.8  which  specifically 
covers  the  general  plan  and  most  of  the  points  outlined  in  NOLTR  61-102. 

c.  In  October  1966  the  Committee  on  Scientific  and  Technical  Information 
Federal  Council  For  Science  and  Technology  issued  a  "Standard  For  Descriptive 
Cataloging  of  Government  Scientific  and  Technical  Reports.”  (AD  ol4l092). 

d.  In  November  1906  Military  Specification  "Research  and  Engineering  Report" 
MIL-R-l8l36D(AS)  which  superseded  MIL-R-l8l3oC(WP)  of  1  December  1963  was  issued 
covering  requirements  for  Form  H73  in  contactors'  reports. 

e.  In  1908  the  DOD  in  joint  operation  with  the  Engineers  Joint  Council 
issued  "Thesaurus  of  Engineering  and  Scientific  Terms."  This  document  should 
be  of  material  aid  in  assigning  key  words.  (AD  o?2000). 

f.  In  March  19o8  DDC  issued  a  document  "Abstracting  Scientific  and  Technical 
Reports  of  Defense-Sponsored  ROT&E."  (AD  ;u7000). 

The  above  items  provide  any  organization  that  originates  reports  with  the 
necessary  tools  to  complete  a  quality  form  IU73  and  materially  reduce  library 
costs  to  recipients  of  the  originator's  report. 

9.  Conclusions: 

1.  The  outside  sources  sending  technical  reports  of  interest  to  NOL  remain 
essentially  the  same  as  that  reported  in  NOLTR  oi-102.  This  is  probably  true  for 
all  DOD  components  that  maintain  technical  report  collections. 

2.  While  DOD  Instruction  3200.8  is  mandatory  on  DOD  activities  and  their 
contractors,  at  least  Jo. ji  of  their  reports  fail  to  include  the  DOD  Form  1773* 
After  five  years  the  question  should  be  asked,  why  isn't  there  10C4  compliance 
with  a  mandatory  requirement?  What  steps  should  be  taken  to  obtain  compliance? 

The  poorest  performer  of  the  major  DOD  activities  was  Navy  and  its  contractors. 

3.  While  it  is  recognized  that  the  descriptive  cataloging  portion  of  the 
Fora  H73  i*  relatively  easy  to  do,  the  overall  quality  performance  shows  that 
for  at  least  in  S.L4  of  the  reports  containing  For®  1173,  the  quality  was  judged 
as  poor.  Subject  cataloging  (the  assignment  of  kev  words)  is  a  more  difficult 
task.  For  those  reports  containing  a  Form  U73,  the  overall  quality  performance 
shows  that  at  least  12. of  the  reports  had  either  nothing  or  quality  Judged  as 
poor  and  requiring  additional  work.  It  should  be  obvious  that  for  every  report 
that  does  not  contain  a  completed,  quality  Fora  1^73,  each  recipient  of  that  report 
■ust  do  cataloging  work  that  ie  essentially  duplicated  by  every  other  recipient  of 
the  same  report.  After  five  years  DOD  still  h&s  a  long  way  to  go  to  realize  the 
potential  of  cost  reduction  that  is  available  If  1004  compliance  with  DOD  Instruc¬ 
tion  3200.8  and  properly  executed  fonts  are  included  in  each  report  published  by 
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activities  controlled  by  the  instruction.  What  is  still  not  apparent  f ^  many  is 
the  vasted  effort  that  is  the  result  of  unnecessary  duplication  of  -fort  pointed 
out  in  NOLTR  nl-102.  Otherwise,  DOD  or  the  headquarters  or  'to  major  activities 
would  have  taken  steps  to  realize  the  eatings.  The  fallowing  tai le  presents  a 
summary  of  the  data  for  the  three  areas  examined. 


Summary  of  Deficiencies 
(at  90fo  Confidence  Level) 


Per 

cent  not 

Per  cent  Poor 

Per  cent  Poor 

Using 

Descriptive 

Subject  Cataloging 

Activity  DOD 

Form  I-73 

Cataloging 

or  none  at  all 

Navy 

•w.O 

4.2 

9-5 

Navy  Contractors 

31.0 

3-- 

8.5 

Army 

0.3'> 

0.0 

~ .  U 

Army  Contractors 

3." 

14.0 

Air  Force 

3-0 

0.0 

14.2 

Air  Force  Contractors 

14.0 

3-1 

4,0 

DASA  Contractors 

1.3 

7.0 

32.0 

ARPA 

0 

0 

0 

DIA 

ho.O 

0 

0 

OVERALL 

2o.3 

H-* 

12.  q 

Since  DOD  Instruction 

3200.8  also 

made  provision  on 

an  optional  basis  for 

adding  "role  indicators”, 

it  is  interesting  to  note  that 

only  or.“  report  in  -0 

exercised  this  option.  Also  since  tins  involves  considerable  work,  almost  1004 
chose  ret  to  do  this  considerable  extra  work.  A  serious  question  is  then  raised 
for  its  continuation  as  a  provision  in  the  DOD  Instruction. 

10.  Recommendations 

1.  Obviously,  the  first  recommendation  is  for  DOD  to  take  steps  to  Obtain 
compliance  with  He  Instruction  3200.8.  Large  cost  sa-.  inga  are  realize*:- le.  At. 
the  major  activity  level  of  DOD  and  foe  selfish  reasons  (savins  money  and  manpower), 
these  major  activities  should  take  immediate  steps  to  insure  compliance  with  a 
quality  product. 

2.  As  a  substitute  for  the  optional  "r^le  indicator'’  requirements,  it  is 
again  suggested  as  per  the  suggestion  in  JfOLTH  :  1-10?  that  subject  cataloging 
entries  (key  words  or  descriptors)  re  entered  on  the  Form  l-*"3  in  descending  order 
of  importance.  This  is  easy,  cheap,  uncomplicated,  and  of  material  value  to  the 
library  personnel  involved  in  technical  information  storage  and  retrieval. 

3-  There  is  still  a  relatively  large  manner  of  reports  generated  by  govern¬ 
ment.  agencies  not  controlled  by  DOD,  rut  which  iss,.r  rep.,  rt  s  of  value  and  are  used 
by  DOD  activities.  DOD  should  take  steps  to  work  out  agreements  with  both  NASA 
and  AFC  (a  total  of  of  all  reports  received  in  this  sample)  to  cause  them 

to  include  Fora  1  -- V 3  in  their  reports.  The  savings  to  DOD  activities  receiving 
NASA  and  AFC  reports  would  be  substantial . 
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Special  Note 

ODDP&E  requested  the  authors  to  add  the  following  statement  to  this  report: 

"Add  statement  that  the  experience  of  Defense  Documentation  Center 
where  ^5,914  technical  reports  received  in  calendar  I968,  93 $ 
included  DD  Form  1473." 

Since  no  additional  information  was  available  or  published  reports  offered 
as  to  the  sources  Ox  DDC  documents  or  on  the  completeness  or  quality  of  the  infor¬ 
mation  on  the  DD  Form  1473,  the  authors  can  make  no  evaluation  or  comparison 
with  author’s  study  as  to  how  much  library  work  (because  of  DD  Form  IU73 
deficiencies)  was  necessary  to  put  the  reports  into  a  library  system  operated 
by  each  activity  that  received  copies  of  these  same  reports. 
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’2  5P  On  50  R  G  Ml  L  l  T  AR  V  ACTIVITY 


ABSTRACT:  An  NOL  study  on  the  use  of  DOD  form  ll*73>  aB  required  by  DOD  Instruction 
3200.8,  indicates  that:  (a)  26.3  percent  of  DOD  activities  and  their  contractors 
are  not  using  it;  (b)  the  descriptive  cataloging  when  included  on  DOD  form  ll*73 
was  Judged  to  be  of  poor  quality  in  5*^  percent  of  all  DOD  reports;  (c)  whe»  DOD 
form  1U73  was  included  in  DOD  reports,  12.9  percent  were  Judged  to  be  of  either  poor 
quality  in  the  subject  cataloging  (assignment-  of  key  words),  or  provided  no  key 
words  at  all.  Positive  steps  should  be  taken  by  DOD  to  obtain  compliance  in  the 
use  of  DOD  form  11*73.  Application  of  DOD  form  11*73  to  NASA  and  AEC  reports  should 
be  negotiated  by  DOD,  in  order  to  realize  the  full  potential  of  a  significant  cost 
saving  in  technical  library  operations. 
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